Latent Diffusion Bridges for Unsupervised Timbre Transfer Demo¶

This demo page is for the paper Latent Diffusion Bridges for Unsupervised Timbre Transfer

Source code: link

Table of Contents¶

  1. Timbre Transfer Results
    1.1. Normal Instruments Created with Our Method
    1.2. Pitch-Shifted Flute
    1.3. Chunk-Based Minibatch

  2. Impact of Different Sigma Max and Sigma N

  3. Shared Space and Cycle Consistency
    3.1. Similar Melodies Examples
    3.2. Cycle Consistency Graph

Timbre Transfer Results¶

Normal Instruments Created with Our Method¶

flute -> violin
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
flute -> trumpet
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
violin -> flute
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
violin -> trumpet
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
trumpet -> flute
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
trumpet -> violin
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
bassoon -> cello
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
cello -> bassoon
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image

Pitch-Shifted¶

flute -> bassoon
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
flute shifted -20 semitones -> bassoon
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
flute shifted -25 semitones -> bassoon
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image

Chunk-Based Minibatch¶

flute -> violin with time chunk size 4 and channel chunk size 0
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
flute -> violin with time chunk size 4 and channel chunk size 32
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
violin -> flute with time chunk size 4 and channel chunk size 0
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
violin -> flute with time chunk size 4 and channel chunk size 32
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image

Impact of Different Sigma Max and Sigma N¶

violin -> noise -> flute (with sigma_N=100)
Your browser does not support the audio element.
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
No description has been provided for this image
violin -> flute
Your browser does not support the audio element.
Your browser does not support the audio element.
Your browser does not support the audio element.
No description has been provided for this image
No description has been provided for this image

Shared Space and Cycle Consistency¶

Similar Melodies Examples¶

Cycle Consistency Graph¶